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ABSTRACT 



max 



A survey of the methods of solving the integer program, 
n n 



y c.x. subject to y a. .x. = b. (i=l 
j=l ^ ^ j£l D 



,m) and 



Xj _> 0 and integer (j = l,...,n) is presented. Emphasis is 
placed on methods developed since 1960 with many as yet un- 
published methods presented. Examples are given for the 
unpublished methods. 
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1. Introduction and Brief History 

This is a survey of the progress that has been made in 
the solving of linear programming problems when variables 
must take on integer values. The field is divided into pure 
integer programming, when all the variables must be integers, 
and mixed integer programming, when only specified variables 
must be integers. The siabject is also known as discrete 
programming or integer linear programming abbreviated to 
integer programming which appears to be the preferred term. 

The integer programming problem is to 

n 

(1) Maximize c.x. 

j=i 3 3 

n 

Svibject to I a. .X . = b . (i=l , . . . ,m) 
j=l ^ ^ 

Xj ^ 0 and integer (j=l,...,n), 

where for simplicity and without loss in generality we as- 
s\ame all a. ., c., b. are integer valued constants. 

There are five approaches capable of solving problems 
of this type: cutting plane methods, primal methods, branch 

and bound methods, partial enumeration methods, and dynamic 
programming procedures. These various methods will be dis- 
cussed in the succeeding sections. 

Although an attempt is made in this thesis to delineate 
the various methods of solving integer linear programs , there 
are no clear cut divisions. Many authors have grouped branch 
and bound, branch and exclude, and dynamic programming tech- 
niques into a broad category of partial enumeration methods. 
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If a solution of (1) as a linear program does not have 
the required integer properties then methods for achieving 
it must be invoked. A basic approach common to most methods 
is to successively deduce supplementary linear constraints 
from the linear constraints of (1) and the integer require- 
ments until a new linear program is obtained whose solution 
satisfies the integer requirements. 

The idea of new constraint generation appears to have 
been first advanced by Dantzig, Fulkerson, and Johnson [7] 
in 1954 in their work on the traveling salesman problem. 

In 1958 Gomory [H] developed a systematic method for new 
constraint generation in his "Method of Integer Forms" for 
solving pure integer programming problems in which all var- 
iables are required to be integer valued. This method guar- 
antees that an integer solution is found (if any exist) in 
a finite nxamber of steps. In 19 60 Gomory devised another 
method, the "All Integer Method", which requires only addi- 
tion and subtraction in computation provided the a^^ and Cj 
in (1) are integer valued. The above algorithms are "dual 
methods" and as such, no feasible solution to the problem 
of interest is obtained until an optimal solution is found. 
There is, however, a method which provides primal integer 
solutions. This method is attributed to Gomory but liter- 
ature on this is scarce. Young [21] has also presented a 
similar algorithm for primal integer solutions. 

The field of mixed integer programming is less far ad- 
vanced. Gomory [12] has extended his method of integer 



6 



forms to deal with continuous as well as integer variables. 

A dual decomposition approach due to Benders [4] has been 
used to remedy the situation of a mixed program. In this 
approach the problem is partitioned and every stage of the 
computation involves the solution of two subproblems , a pure 
integer problem and a linear programming problem. 

Other approaches to solving pure and mixed problems 
have been proposed. In 1960 Land and Doig [20] developed 
a branch and bound technique. In 1968 Greenberg and 
Hegerich [19] developed a branch and exclude algorithm for 
the special "knapsack problem" which was extended by 
Greenberg [15] to the more general problem. 

Partial enumeration techniques have also been devised 
by Balas [1] and [2] in his "Additive Algorithm" and "Dis- 
crete Programming by Filter Method", Goeffrion [8] in his 
"Reformulation of Balas' Algorithm for Integer Programming", 
and by Glover [10] in "A Multiphase Dual Algorithm for the 
Zero-One Integer Programming Problem". An enumerative 
scheme for computation of knapsack functions by Greenberg 
[18] is presented in this paper. 

Dynamic programming procedures have also been devised 
to solve linear programming problems. Two methods by 
Greenberg [16] and [17] are presented; one for the knapsack 
problem and the second a more generalized problem of integer 
programming . 
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2. Cutting Plane Methods 

Before discussing the particular algorithms of Gomory 
it is appropriate to define some terms which will be used 
throughout the discussion of the algorithms. A "feasible 
solution" is a solution where all variables that are required 
to be integer are integer and all variables that have to be 
non-negative are non-negative. Since Gomory 's methods are 
expressed more neatly in terms of an objective function to 
be maximized the objective function will be 

n 

(2) Maximize x„ = T c.x. 

“ jii 3 ^ 



An "optimal feasible solution" is a feasible solution 
which yields the largest value of Xq. 

In the original method for pure integer programming, 
the "Method of Integer Forms", one starts by solving the 
problem by ignoring the requirement that the variables must 
be integer. If this produces a solution in integers, then 
the problem is solved. Otherwise one considers the expres- 
sion for some basic fractional variable in terms of the 
non-basic variables. Let this be 

n 



X 

s 



sO 



j=l 



a . t . 
SD D 



where t. denotes the j non-basic variable. 

Now write the coefficients a . in the form 

SD 

a . = n . + f . 

S3 S3 S3 



where the n^^ are all integers (positive or negative) and 
the f . are fractions such that: 0 < f ^ . <1 . 

S3 - S3 
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Next consider the expression: 



n 

s = -fri + y f.t. 

sO sj j 

This expression must be an integer since it differs 



from -Xg by an integer. Also, it cannot be less than “fgQ 

n 

since the expression ^ f .t. is non-negative. So s is a 



j=l 



SD 3 



non-negative integer and can be introduced as a new variable 
of our problem. Its value at the current trial solution is 
-f So the constraint that s > 0 "cuts off" this solution 

and enables us to continue optimizing using the dual simplex 
method . 

Gomory ' s second method for pure integer programming, 
the "All Integer Method", proceeds differently. One does 
not start by solving the problem in continuous variables 
since this method involves keeping the coefficients integral. 
One starts by making the problem dual feasible, perhaps by 
adding an artificial constraint that the sum of the non-basic 
variables is less than or equal to some arbitrarily large 
number. After this every pivotal row is a new cut generated 
in such a way as to make the pivot equal to -1. This en- 
sures that the integral tableau remains integral. The proce- 
dure for generating pivotal rows is as follows: Suppose x^ 

is some variable that is negative in the current trial solu- 
tion, then express x^ in terms of the non-basic variables as 

n 

x=a,. - y a.t. 
s sO s: 3 

where a^Q is negative. 
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Let X be any positive quantity and write 



a . = An . + f . 
sj s] S 3 

where n^j is an integer and 

0 < f . < A . 

- S] 

Consider the expression: 



n 

s=n„- y n.t. 
sO . ^ , SI 1 
] = 1 



This expression must be integral and positive since 



n 



"sO 



y f . t . < f ^ 

jil s] ] - sO 



< A 



For any value of A , n » < -1 if a ^ < 0 . So the new con- 
straint that s ^ 0 "cuts off" the current trial solution. 

The pivot can be made equal to -1 by taking A large enough 
since for arbitrarily large A all n^j will be 0 or -1 depend- 
ing on whether a^^ is non-negative or not. 

Just as constraints for the Method of Integer Forms can 
be generated from linear combinations of rows provided it is 
integral, constraints for the All-Integer Method can be gen- 
erated from linear combinations of rows provided it is non- 
negative . 

The third and final cutting plane method which we will 
consider is Gomory's method for the mixed integer problem. 
This method is similar in part to the method of Integer 
Forms in that one first solves the problem ignoring the re- 
quirement that any variables must be integral. If some var- 
iable that must be integer, say x^ , equals n^Q + fgQ/ where 
n^Q is a non-negative integer and 0 £ f^Q < 1, then x^ can 
be expressed in terms of the current non-basic variables as 
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X 



=n_+f_+ya .t. + Tb ,t. 
sO sO i S3 3 I S3 3 



where the non-basic variables are divided into two clas- 
ses such that all a . > 0 and all b . > 0. 

S3 - S3 - 

Consider the expression: 



s = -f 



o + Ta .t. + T— > 
sO ^ S 3 3 1-f 



sO 



sO 



Tb .t. . 

£ S3 3 



This expression is negative at the current trial solution 

but is must be non-negative for any integral value of x^. 

This is because if x - n „ < 0, then 

s sO — ' 

s > -f o + Ta .t. - Tb .t. = -(x -n -) >0 

— SI) ST T ^ ST T S Sf) — 



+ 



S3 3 t S3 D 



and ifx -n_>l, then 
s sO — 



1-f 



sO 



> -(1-f f.) - Ta .t. + Tb .t. = X - n „ > 0 
— sO f ST n ^ S3 T s sO — 



-so -- + -3 D i S3 3 

So s ^ 0 and this is a valid cut. If any of the non-basic 
variables must be integral then an expression for x^ plus an 
integer combination of the non-basic integer valued var- 
iables, such that a . < f n or b . < (l-f„,^) for all such 
variables can be used. 
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3 . 



Primal Methods 



The primal approach involves progressing from one fea- 
sible solution to another with a larger value of the objec- 
tive function or else proving that no better solution can 
exist. A method, attributed to Gomory , and conveyed to the 
author in private conversation with Greenberg is a method 
of solution to the general problem 

n 

( 3 ) Maximize J c.x. 

j=l => ^ 

n 

Subject to y a..x. = b. (i=l,...,m) 

13 D 1 

Xj ^ 0 and integer. 

Along with the discussion of the algorithm will be an illus- 
trative example which is 

( 4 ) Maximize x^^ + X2 
Subject to 3 Xj^ + 2 X2 £ 7 

Xi , ^2 ^ ^ integer. 

Adding a slack variable, S, to our constraint equation and 
making a substitution x^ = x^ and X2 = X2 » ( 4 ) may be re- 

written as 

( 5 ) Maximize x^^ + X2 

Subject to 3 x^ + 2 X2 + S = 7 

- Xj^ + Xj^ = 0 

- X2 + X2 = 0 

Xi , X2 ^ 0 and integer. 
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Set up the first tableau using (5) . This is the following 



Xi X2 S x^ X2 b 



3 2 1 0 0 7 



-1 0 0 1 0 0 



0-10 



0 10 



1 1 0 0 0 0 



with the last row of the tableau the coefficients of the 
objective function. Since this is a maximize problem, the 
pivot column will be the column where the coefficient of 
the objective function is the greatest. In this case our 
pivot column will be either x^^ or X 2 * Arbitrarily select 
the x^ column. The criteria used for selection of the pivot 
row is 

b. 

min (— ) where a is the pivot column. 

In our problem the pivot element is 3. 

We divide the pivot row by the pivot element giving 



( 6 ) 





Rewriting (6) gives us 



Xi + 2^2 + 3S 3 



or 



(7) 1;^ + |s - i = 2 - 



Since the left side of (7) is > 0 then the cut is 
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Using (6) , we take the greatest integer £ the elements 
of the pivot row giving us 

1 0 0 0 0 2 . 



We must always keep the slack variable, S in our case, 
and the original variables, and in the basis. 

Since the right side of (7) implies _< 2, we must 
add a slack variable, say t^^, giving us 

(8) + tj^ = 2 . 



We now eliminate our pivot variable x^^ from the equa- 
tions in our tableau by using (8). 

Next we determine if this is an optimal solution. If 
not we must repeat this procedure. If our pivot element is 
1 at any step, we must modify the procedure by substituting 
dummy variables for the variable we want to keep in the 
basis . 

Continuing with our example and using (8) our next 
tableau is 



-3 

1 

0 

-1 



2 

0 

-1 

1 



S Xj^ X 2 b 

10 0 1 

0 10 2 

0 0 10 

0 0 0 2 



Note that the x^^ column has been eliminated. 

Our next iteration allows us to eliminate X 2 from the 
basis by rewriting line one of the tableau as 

- — t, + X + — S = — ”2t, + X- = 0 

2^1 ^^222 12 
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Substituting ^2 = 2 t^ - ^2 in our tableau gives 



1 

1 

-2 

1 



-2 

0 

1 

-1 



s 

1 

0 

0 

0 



Xi X 2 b 

0 0 1 

10 2 
0 10 



Using the column headed by t^ as our pivot column now 
requires the use of our modified procedure since our pivot 
element is 1 . 

Writing line one of the above tableau, not including 
S, gives 



^1 ” ^^2 — ^ 
Adding a slack variable t^ gives 

or t-^ = 1 + 2t2 - t^ 



Substituting this in our previous tableau and elimina- 
ting the t^ column gives 



-1 

-1 

2 

-1 



0 

2 

-3 

1 



S x^ X2 b 

10 0 0 

0 10 1 

0 0 12 

0 0 0 3 



Using the column headed by t2 as our pivot column 
allows us to eliminate t2» 
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Writing line two of the above tableau after dividing 
by the pivot element gives 

1 +- ^ 4 - ^ 1 _ 1 

2^3 ^2 2^1 “ 2 

and using our procedure gives 



~^3 ^2 — ^ 

Adding a slack variable, t^ to this equation allows us 
to substitute 



t 



2 




t 



4 



in our tableau giving 

t3 t^ S Xj_ 

-10 10 

1-2 0 1 

-13 0 0 

0-10 0 



X2 b 

0 0 
0 1 
1 2 
0 3 



which is an optimal solution with x^^ = l, X 2 = 2, s = 0, 
and 3 as the value of the objective function. 

In this problem there is an alternate solution indica- 
ted by the 0 element in the last row of the t^ column in 
the previous tableau. 

Continuing with our procedure and using the t^ column 
as the pivot column, we obtain an alternate optimal solution 
of Xj^ = 0, ^2 ~ ® ^ value of the objec- 

tive function. 
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4. 



Branch and Bound Methods 



A third approach to the integer programming problem is 
the branch and bound technique. This involves setting up 
a tree of linear programming problems. The root of the tree 
is the problem in which all integrality constraints are 
ignored. If the solution satisfies the integer requirements 
then the problem is solved. Otherwise a branching procedure 
is employed to obtain an integer solution to the problem. 

Three methods will be discussed in this section. The 
first is the Land and Doig procedure [20] which was pub- 
lished in 1960, the second method by Greenberg and Hegerich 
[19] which was devised in 1968 and applied to the knapsack 
problem, and the third method by Greenberg [15] in 1968 
which was an extension of [19] to the more generalized 
problem. 

The general approach of the Land and Doig procedure is 
to solve the integer program ignoring the integrality con- 
straints. If the solution = (y. ,x? , . . . ,x^ , ) satisfies 

the integrality constraints the problem is solved. If not 
then the present value y^ of the objective function provides 
an upper bound on the value of the optimal solution to the 
integer program. 

A variable Xj^ which is required to be integer valued 
but currently is not, is considered. The variable must be 
forced to take on an integer value hence decreased to [x^l 
or increased to at least [x^l + 1 where [x^l is the great- 
est integer less than or equal to Xj^. The entire range of 
possible integer values for Xj, may be found by solving the 
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two linear programs max Xj^ and min Xj^ subject to the con- 
straints of (2) . For each possible integer value in the 
range the max subject to the constraints of (2) with Xj^ 
fixed can also be computed by linear programming. Thus, r 
all possibilities in the form of a directed tree can be 
enumerated with the root of the tree, with rooted node 0, 
corresponding to , and directed branches (0,i) with node 
i corresponding to the solution of the linear program 
max Yq subject to the constraints of (2) and x^^ set at some 
specific integer value, say • From each new node the 

same procedure can be applied. Continuing until no further 
branching is possible, every terminal node will either cor- 
respond to a feasible integer solution or to some sequence 
of integer valued choices which do not satisfy (2) . The 
feasible node with max Yq provides the optimal solution. 

The Land and Doig procedure involves this enumeration 
but attempts to search only a subset of the possibly immense 
tree described. The idea is to develop only that part of 
the tree which contains the optimal solution. Any node in 
the directed tree must have a value of no greater than 
its predecessors' since branching is imposing an additional 
variable to some integer value, i.e., imposing an additional 
constraint. Also if at any node of the tree, x is 

ir 

integer restricted and is not integer then the integer 

values for x which will result in the least decrease in y« 

P . . 0 

after branching must be either [x^^M or + 1. Thus 

^ p p 

we have reduced the total number of branches that need be 
explored. 
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Another approach to the branch and bound or more pre- 
cisely branch and exclude method is that of Greenberg and 
Hegerich. Their original work was with the knapsack problem 
and later extended by Greenberg to the generalized integer 
programming problem. 

They present a branch and bound algorithm and a branch 
and exclude procedure which is used to solve the problem 

n 

(9) Maximize J v.x. 

1=1 ^ ^ 



n 

Subject to ^ w.x. < W 
i=l ^ ^ 

x^ = 0,1 (i=l , r . . ,n) 

It is assumed that and w^^ are positive integers and 

Vi/Wi ^ V 2 /W 2 1 ••• 1 

The problem is first solved as shown by Dantzig [6] 
where the 0 £ _< 1. This solution is given by 

X. = 1 if i < r 
1 

X, = 0 if i > r 
1 



X = 

r 



w - y w. 
i < r ^ 
w 



where r is the least integer (0 _< r n) for which 

y w. > W. If no r exists then all x. = 1. If x = 0, 

. ^ 1 — 1 r 

1 _< r 

then we have the optimal solution to (9) , 

If x^ is fractional the value of the objective function 

is Z(l) = I V. + V X . Z(n) is the value of the objective 
i < r 
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function at node n. The branch and bound method is 

1. Label node 1 with Z(l). 

2(a). Find the terminal node with the largest 

value of Z(n) . This is the node at which 
the next branching will take place. Any 
node (except one) contains the effect of 
assigning values to variables and solving 
(9) with the assigned values of the 
variables added as constraints. 

(b) . If the solution at node n has all variables 
assigned an integer value, this is the 
optimal solution to (9) . If not, proceed 
to step 3. 

3(a). Set n = n + 1 and some unassigned variable, 
say x^ to 0. Solve (9) with all assigned 
variables added as constraints. Label 
node n with the value Z(n) and proceed to 
3(b) . 

(b) . Set n = n + 1 and x^ = 1. Solve (9) with 

all assigned variables added as constraints. 
Label node n with the value Z(n) and go to 
step 2. 

The criteria used to select x^ in step 3(a) is to take 
the variable that is fractional at node n. 

As is common with most branch and bound techniques they 
require large amounts of computer storage. The branch and 
exclude algorithm which is described next is designed to 
eliminate the problem of storage. The algorithm first finds 
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an obvious integer solution to the constraints of (9) . This 
solution is taken as a lower bound to the optimal solution. 

A branch of a tree is developed and each part explored until 
the lower bound is reached or until a new feasible solution 
is found that represents a larger lower bound. Then back- 
track and develop new branches of the tree developing pos- 
sibly larger lower bounds. Further branching is excluded 
when the lower bound is reached. The algorithm stops when 
all new branches are excluded. The only information that is 
stored is the current lower bound solution and the branch 
routing. At the end, the lower bound solution is optimal. 

Before the algorithm is presented certain terms must 
be defined. 

Define S (x» /X, , . . . ,x ) as the current lower bound solu- 
0' 1' ' n 

n 

tion where the x. are all given and x^. = ^ v.x.. 

1 u 1 1 

Define X (x^^ ,X 2 , , . . ,x^) to indicate assigned variables. 

A value x^ = 2 (or any number not equal to zero or one) 
indicates the variable is unassigned. An assigned variable 
will have the value zero or one. 

th 

Define R(L) as the index of the L assigned variable. 

Define Z (L) as the value of the objective function at 

th 

the L level of a branch. 

The solution to (9), with L assigned components of X 
added as constraints is 

x^ = 1 if i < r, i ^ R(j) (j=l,...,L) 

x^ = 0 if i > r, i 7 ^ R(j) (j=l,...,L) 
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(10) ^R(j) = 0 1 (j=l,...,L) depending on the 

assignment 



X 



= (W - I w ... - I w.)/w 

i=l ieM(L) 



= ,I,''R(i)==R(i) ^ ,i 



eM(L) 



V. + V X 

1 r r 



where the set M is given by 

M(L) = {i|i < r, i 7 ^ R(j) (j=l,...,L)} 
and r is the least integer (0 < r < N) for which 



I 

ieM(L) 



w , 



W^ > 



W 



L 

j3^^R(i)'^R(i) • 



If no r exists we have all x^ = 1 for i R(j) (j=l 
A lower bound to the solution of (9) is given by 



x(L) 



L 

J^''R(i)''R(i) 



+ I V. . 

ieM(L) ^ 



,L) . 



The algorithm is as follows: 

1. Set L = 1 and all components of X to two. 

2. Solve (9) with 0 < x. < 1. If the solution is all 

— 1 — 

integer then this is the optimal solution. If not, the sol U' 
tion is x^ = 1, ^2 - l,...,x^_^ = 1 and x^ is fractional. 
Calculate Xq = I form S (Xq ,1 , 1 , . . . , 1 , 0 ,0 ,0) as a 

lower bound to the optimal solution, where the zero compos 

nents in S represent x^ = 0, i ^ r. Set R(l) = r and the 
th 

r component of X to zero. 

3(a). Solve (9) with the L assigned components of X 
added as constraints. We obtain (10). If [Z (L + D1 £ 
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go to step 4. If Z(L+1) > and we have an integer solu- 
tion, take x» = Z(L+1), form a new S (x. ,Xi , . . . ,x ) from (10) 
u Din 

and go to step 4, If [Z(L+1)] > Xq . and we do not have an 
integer solution, go to 3(b). 

(b) . If x(L) > Xq , take Xq = x(L) and form a new 
S (Xq ,Xj^ , . . . ,x^) from (10) with x^ = 0 . In any case, set 
L = L + 1, take R(L) = r, and set the R(L) component of X 
to zero and go to 3(a). 

4(a). If the R(L) component of X is equal to zero 
change the component to one and go to 3(a). If the R(L) 
component of X is one go to 4(b), 

(b) , If L = 1, the optimal solution is S (Xq ,x^^ , . . . , 
x^) . lilt ^ 1, change the R(L) component of X to two, set 
L = L-1, and go to 4(a), 

This completes the algorithm. R(L) represents a rout- 
ing of assignments along the branch. Only one branch is 
studied at a time with preference given to assigning the 
value of zero to the fractional variable. This allows lower 
bounds to be achieved more rapidly. The only permanent 
storage information required is the current lower bound solu- 
tion S, the assigned variables R(L) at level L of the branch, 
and the assignment vector X, 

An extension of the previous algorithm is that of Green- 
berg [15] in which he presents an algorithm for the solution 
of the integer programming problem 

(11) Minimize Z = CX 
Subject to AX = B 

0 _< Xj £ bj , Xj integer, j=l,,..,n. 
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where C is an n-vector, B is an m-vector, A is an mxn matrix 
and the are positive integers. Any or all of the may 

be infinite. It is assumed that the elements of C, B and 
A are integers. 

The two phase simplex method is used to solve (11) to- 
gether with the bounded variable technique of Dantzig. After 
solving (11) as a linear program, the condition Xj^ £ 

Xr ^ [x^] + 1 for a basic variable Xj^ with its value x^ as 
fractional is imposed. The solution for the linear program 
is then infeasible. Then Xj^ is placed at either the new up- 
per bound or at a lower bound [x^] + 1, an artificial 

variable equal to the amount of the infeasibility produced 
(x^ - [x^] in the first case or [x^] + 1 - x^ in the second 
case) is added, and the new bounded variable problem is 
solved by the two phase procedure. If a solution is obtained 
to the new problem that is fractional, an additional condi- 
tion X _< [x^] or X > [x^] + 1 is imposed for a basic var- 
iable x^ with its value x^ as fractional. The new problem 
is then solved maintaining the constraint of x^,. This proc- 
ess is continued until it is necessary to backtrack which is 
done by simply removing the bounds on the required variables 
and solving the linear program to return to a previous prob- 
lem. Note that bounds on the same variable may appear 
again; the initial bounds will automatically be satisfied. 

This entire procedure enumerates possibilities for the 
solution to (11) in a directed tree. The rooted node cor- 
responds to Z*^. Only one branch is investigated to the next 



node corresponding to the solution of (11) with say 
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Xj^ ^ ^ representing the branch. From each node the 

same procedure is repeated investigating one branch until 
we backtrack to a previous node that has had only one branch- 
ing. For example, we would branch to a node corresponding 
to the solution of (11) with x^^ ^ representing the 

branch when we backtrack to the rooted node. Any further 
backtracking to the rooted node would end the problem. This 
procedure is contained in the following algorithm: 

Define S (Xq , x^ , , . . ,x^) as the current upper bound 
solution, which represents a feasible integer solu- 
tion to (11) with objective value Xq. 

Define I (L) as the index of the L — bounded 
variable. 

Define N(L) to show the number of branchings for 

the L— bounded variable (Initially N(L) = 0). 

th 

Define B(L) to show the bound on the L — bounded 
variable. 

th 

Define G(L) =0 to indicate the L— bounded 
variable is £ B(L) , and G(L) = 1 to indicate the 
L— bounded variable is ^ B(L) . 

1. Set L = 0 and take S (Xq ,x^^ , . . . , x^) as a feasible 
integer solution to (11) . If none is apparent 
take Xq as infinite. Solve (11) as a linear program. 

If the solution is all integer the problem is solved. 
Otherwise go to 2 maintaining the canonical form of 
the solution to (11) . 
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2. Set L = L + 1. Go to 2(a) . 

(a) Select a basic variable that is fractional. 

Suppose the variable selected is Xj^ with 
value x^, set I (L) = k, N(L) =1 and go to 
2 (b) or 2(c). 

(b) Set B(L) = [x°] and G(L) = 0. Go to 3 

(c) Set B(L) = [x°] + 1 and G(L) = 1. Go to 3. 

3. Solve the linear program using the maintained canonical 

form with the new bounds on the variable Xj^ where 

k = I (L) . One of the cases holds; 

(a) If the solution produces an objective value Z 
with [Z] + 1 ^ Xq to to 4. 

(b) If the solution produces an objective value Z 
with [Z] + 1 < Xq and the solution is all integer, 
redefine S (Xq , x^^ , . . . ,x^) as a new feasible integer 
solution where Xq = Z, Xj^,...,x^ is the new solu- 
tion. Go to 4. 

(c) If the solution produces an objective value Z 
with [Z] + 1 < Xq and the solution is fractional 
go to 2 . 

(d) If the problem has an infeasible solution go 
to 4 . 

4. Set LL = L and go to 4(a). 

(a) If N (L) = 2, go to 4(b). Otherwise N (L) = 1; 
go to 4(c). 

(b) If L = 1, the feasible solution S (Xq ,x^^ , . . . ,x^) 
is optimal. Stop. Otherwise set N (L) =0, 

L = L-1, and go to 4(a) . 
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(c) Solve the linear prograimning problem starting 
from the current canonical form with the bounds 
B(L), B (LtI) , . ^ . ,B (LL) removed. If k = I (L) 
and does not become a basic variable then 
the solution is non-unique; is then made a 
basic variable. Go to 4(d). 

(d) If G(L) = 0, set B(L) = B(L) + 1, N(L) = 2 , and 

go to 3. Otherwise G(L) = 1; set B(L) = B(L) - 1 , 

N (L) = 2, and go to 3. 

It should be noted in this algorithm the bounds are 
changed systematically until the optimal integer solution 
is produced. The method results in a branching process that 
requires minimum excess computer storage over that required 
to solve the linear programming problem. 

In addition, dynamic programming enumeration, similar 
to that given in [17] and developed in the dynamic program- 
ming section of this thesis, may be instituted after a frac- 
tional solution is obtained at any node to speed the calcula- 
tions . 

To illustrate the basic method, an example from [3] is 
presented where the variables are arbitrarily picked for 
branching and the branching is always taken with a greater 
than or equal sign first. The problem is to 
min 4Xj^ + 5 X 2 
when 3Xj^ + ^2 ~ ^3 ~ ^ 

Xi + 4X2 - x^ = 5 
3 x^ + 2X2 - Xg = 7 
Xj^ , X 2 , x^, , Xg 0 and integer. 
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The continuous solution produces the canonical form 



Xi + 



^2 



X3 + 



-Z + 



2 4 

10^4 " 10^5 " 


18 

10 


3^1 

10^4 10^5 


8 

10 


3 11 

10^4 10^5 


42 

10 


-Ix + iix = 
10^4 ^ 10^5 


112 

10 



Since the solution is fractional we arbitrarily select the 
boimd x^ > 2 added to the previous canonical form. We then 
obtain the canonical form 



^2 4^1 


“ 


4x . 
4 4 


4 


11 




1 


3 


^3 " T''l 






" " I 


5 




1 


9 


5 " 2^1 




2^4 


~ ~ 2 


.7 ^ 11 




5 


25 


-Z + -^x^ 










^5 


) = 


(47/4, 



We arbitrarily select X 2 1 and solve the previous 
canonical form with x^^ ^ 2 and X 2 1 to obtain the canonical 



form 



X 3 - 3x^ - 



^2 ” 



X 4 - x^ - 4 x 2 = -5 



X 3 - 3x^ - 2 X 2 = -7 



-Z + 4x^ + 5 X 2 = 



where (z ,x^^ ,X 2 ,X 3 ,x^ ,X 3 ) = (13, 2, 1, 5, 1, 1), which is all 
integer and becomes the solution vector S (xq ,X j^, . . . ,x^) . 
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We then remove the bound 1 and apply the simplex proce- 

dure on the previous canonical form (eog., Z may be decreased 
by decreasing X 2 ) and obtain the same canonical form that we 
obtained by selecting the bound Xj^ 2. We them impose the 
bound X 2 0 on this canonical form in addition to x^^ _> 2 
and obtain the canonical form 



^1 




4 x 2 - X 4 = 


5 


^3 


1- 


11 x 2 - 3 X 4 - 


13 




4 


10 X 2 - 3 X 4 - 


8 


-Z 


_ 


llx., + 4x. = 


-20 



where the solution is (20, 5, 0, 13, 0, 8 ). Since Z > 13 we 
remove the bounds ^2 £ 0 and > 2 and solve the previous 
canonical form to obtain our first canonical form again. 

We then take x^ _< 1 and obtain the canonical form 

^ 3 1 _ 7 

^2 2^1 " 2^5 2 

3 17 

^3 ■ 2^1 " 2^5 " 2 

X 4 + 5x^ - 2Xg = 9 

7 5 -37 

-Z - ^X^ 4- ^ 

where (z,Xj^,X 2 ,x^/X 4 ,x^) = (14, 1, 2, 3, 4, 0). Sinze Z > 13 
the problem is solved with solution Z = 13 , Xj^ = 2 , X 2 = 1 , 

X3 = 5, X4 = 1, X5 = 1. 

The advantages of this basic branching algorithm are 
apparent over the Land and Doig procedure even in this small 
example. This same problem solved using the Land and Doig 
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procedure as illustrated in [3] required the generation of 
five nodes. This algorithm required only four. Further, 
no additional problems are generated except that the canon- 
ical form from the original continuous solution is varied 
depending on the bounds on the variables. Each problem 
leads into the next in a natural fashion. 
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5. Partial Enumeration Techniques 

A fourth approach, partial enumeration, is basically a 
branch and exclude method with various rules envoked for the 
purpose of exploring only certain branches of the tree. 

A method for partial enumeration by Balas [1] is pre- 
sented for the case where x^ , ( ]=1 , . . . ,n) equals 0 or 1. The 
problem to be solved should be formulated 

n 

(12) Maximize y^, = I c x . + b„ 

u j^l D D u 

n 

Subject toy =b + ') a x. >0 

^11 j=l 13 D - 

(i=l,...,m) and x^ = 0 or 1, (j=l,...,n). 

In (12) , all Cj must be non-positive. If this is not 
the case, x^ may be replaced by (1-x^) for any Cj > 0. Also, 
some b^ must be negative or the problem has the trivial solu- 
tion with all X. =0. 

3 

There are 2^ different possible solutions. The algor- 
ithm seeks to find an optimal feasible solution or knowledge 
that none exists without having to evaluate each of the 2^^ 
possible solutions. The algorithm is in the form of a tree 
search. A path along the tree of solutions is traced until 
either a new feasible solution is obtained or a node is 
reached which yields information that all solutions in which 
that particular node is included may be ruled out of consid- 
eration. The process then backtracks to the unique node 
that immediately precedes the one ruled out and departs that 
node on a different path unless none are left and it becomes 
necessary to backtrack further. When the process is pushed 



31 



back to the starting node and information is obtained that 
no other branches of the tree need be explored, the algorithm 
terminates . 

Define Sq to be the set of variables presently set equal 
to zero and as the set of variables presently assigned a 
value of zero or one. 

Record the value of yQ for the current best known solu- 
tion. Call this value Yqj^* Record the current values of 
yQ / ^Oc' ^lc'*'*'^mc maximum possible 

values of Y]_ 'Y 2 ' * * * ^lm'^2m' ’ ' ’ '^mm ^Y chang- 

ing the variables in Sq so that 

^im " ^ic ^ max(0,a^.) (i=l,...,m) 

j 

and j is the set {j: x^ e Sq} . 

InitiallY Yqj^ ^®Y equal to -°° and the current 

subproblem has all variables in Sq. The general nature of 
the algorithm is: 

1. Consider a subproblem. If Yq^, £ Yq^ ^t>andon the 

subproblem. Otherwise if all £ 0 for 

(i=l,...,m) a new best feasible solution is 
found. Abandon the subproblem since all _< 0 
and it is unprofitable to assign any variable in 
Sq a non-zero value. 

2. Otherwise if c^ _< yQj^ - yQ^ for any j, put x^ 

in Sj^ and assign it a value of zero. Revise the 
values of y. . If and revised y. <0, abandon 
the current subproblem because it cannot have a 
feasible solution. 
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3. 



with 



If y. + a. . <0 for some i, put x. in S, 
im 1 j j 1 

an assigned value of zero and revise the y, . 

im 

This should be repeated for each y. since a 

■' im 



variable was last assigned to or until 



some 



y < 0 . 

^ im 

4. Ify.-a.. <0 for some i, put x. in S, with 

im 1 j 3 1 

an assigned value of one. Revise all y^^ and 
^ im 

5. If no Xj is assigned a value of one in step 4, 
a branch must be made. A variable in Sq is 
assigned to with a value of one and at the 
same time a new subproblem is set up that is the 
same as the current one except that the variable 
is assigned a value of zero. The choice of 
variable is made by taking that variable that 
when set equal to one increases at least one 
negative y^^ and makes the greatest decrease in 

m 

the sum ^ max (0,-y. ). If two or more var- 
■ >1 1 o 

1=1 

iables are tie, the one with the largest c^ is 
used. 

An algorithm by Glover [10] which in its simplest form 
is similar to the "All Integer Method" of Gomory, but rep- 
resents a weakening of the constraints of this algorithm 
was also a proposal for sharpening the tests of the algor- 
ithm of Balas [1] and hence reducing the size of the solu- 
tion tree. 
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Geoff rion [8] outlined a version of the algorithm by 
Balas [1] which lends itself to computer implementation. 

Balas ' [2] filter method is an accelerated version of 

his earlier "additive algorithm". In the filter method a 
two phase approach is used where in phase I an auxiliary 
problem is constructed that, in phase II, is used to 
"filter" the solutions to which the tests of the additive 
algorithm are to be applied. 

Clever enumerative schemes are in certain situations 
the best methods of solution. An algorithm for the computa- 
tion of knapsack functions by Greenberg [18] falls in this 
category where the problem is 

n 



(13) Maximize ^ 

j = l 



c .X . 

3 : 



Subject to 



n 



j=l 



a .X . 

3 3 



L 



X. >0, and x. integer, 
3 - 3 



where each c^ is a positive number, each a^ is a positive 
integer, and L is a positive integer. In the usual knap“ 
sack problem the constraint in (13) is an inequality con- 
straint. It can be assumed in this formulation that slack 
variables have been added to convert the inequality to 
equality. 

The one-dimensional knapsack function is defined from 
(13) as: 

f n 

y a.x. =x,x. >0, 

jil ^ 3 ^ - 



(14) F(x) = max ^ I c.x. 

j=l ^ ^ 



Xj integer 
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If F(x) can be found for all values of x and in turn 
the Xj found that produces the solutions, then (13) is 
solved when F(L) is found. 

The knapsack function can be written as 

(15) F(x) = max [c. + F(x-a.)] 

j : a . < X ^ ^ 

3 - 

with initial condition F(0) = 0, for values of x that are 
feasible. 

One immediate solution to (15) can be found by find- 
ing a^ = min a^ , for all j. This produces F(a^) = c^. 

Then replace x by x - a^ in (15) and obtain 

(16) F(x-a ) = max [c , + F(x-a -a.)] , 

^ j:a+a.<x ^ ^ ^ 

■> r J - 

which can then be substituted for the F(x-a ) term on the 

r 

right side of (15) . Another immediate solution can then be 
produced. Continue in this manner until F(L) is found or 
until all values of F(x) that are desired are found. Keep- 
ing track of which j produces the solution will enable us 
to determine the optimal x^ at the end. Only distinct 

values of a. are considered. If a. = a. and c . > c, for 
3 3 k 3 - k 

j ^ k , then take Xj^ = 0 . 

The procedure may be summarized in the following four 
steps : 

1. List the values of the problem as follows: 

1 2 3 ... n 




X. = 0 
3 



Set m = 0. Go to 2, 
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2 . 



3. 



Given the list find = min a , for columns in all 

3 

sections. If a^ = L go to 4. Otherwise set m = a 

r = j- 

and go to 3. 

Add a new section of columns to the list, if possible, 
as follows: 

Calculate a^ = a^ + a^ and “ *^r ^ *^t ^ = 1, 

...,n. Add a column headed by t if: 

(a) a^ £ L. 



(b) 

(c) 



is not on the list. 



a^ is on the list and has a corresponding 

c. value that is smaller than c'. 
t t ^ 



(d) Underneath the section added write the 

values from the section where m = a was 

r 



Increase by one for the new 



found, 

section. Sections after the first may be 
deleted after they are no longer needed. 

Go to 2 . 

4. The problem is solved with solution c^. The values 
of the variables are found below the section where 
a^ = L appears, increase x^ by one. 

This completes the algorithm. This algorithm has the 
computational advantage of being a single pass algorithm and 
does not require backtracking. 

To illustrate this method the following problem is con- 
sidered : 



Max 


2x^ 


+ 


10 ^ c 


when 


2Xi 


+ 


3 X 2 + 4x 




^1 


> 


0 , X 2 > 0 



^3 - 
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1. We list the values of the problem as 



1 

2 

2 




X. = 0 
D 





Set m 


= 0. 


Go to 2. 


2. 


Given 


the 


above list we find a = min a. =2. Set 

r 3 




m = 2 


and 


go to 3 . 


3. 


Write 


the 


new section as 



2 3 



5 6 



4. 



5. 



6 . 



We obtain min a^ = 3 in 1. No 
added. 

We obtain min a. = 4 in 1. No 



3 

added. 

The solution is now evident in 
We thus have F(6) = 7, = 1, 



new section is 



new section is 



3, 

x.^ 



where a. =6. 

3 

= 1 as optimal . 
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6. Dynamic Programming Methods 

The solution of a linear program is generally easier 
than that of an integer program. Given a linear program to 
be solved in integers , it is tempting to solve the linear 
program and then, by some process, "round" the noninteger 
valued variables into an optimal integer solution. Partic- 
ularly appealing results of Gomory [13] have led to a 
dynamic programming process for rounding a linear program- 
ming solution into an optimal integer solution. 

Two such approaches will be presented in this section; 
one for the knapsack problem and the other, a continuation 
of the same method, for the solution to a more general 
problem. 

The first algorithm by Greenberg [16] is one for 
solving 

(17) Minimize CX 
Subject to AX = B 

Xj ^ 0 and integer (j=l,...,n), 
where X = , . . . ,x^) , C is an n-vector, B 

is an m-vector, and A is an mxn matrix. It 
is assumed the elements of C, B, and A are 
integers . 

The linear programming solution to (17) transforms 
(17) to 

(18) Minimize d + c.x. 

j eG ^ ^ 

Subject to X^ + y a.x. = a„ 

Xj ^ 0 and integer (j=l,...,n). 
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where = {x^|ieG}, ^ 0 , G is the set of indices of the 

basic variables and G is the set of indices of the non-basic 

variables. The vectors a. (j=0 and ieG) are column vectors. 

J 

The components of Uq are non-negative. If is all integer 

then X. = 0 (jeG) , X = a^, is an optimal integer solution. 

J u 

If any of the aQ are fractional then (18) may be reduced to 
an equivalent knapsack problem 



(19) 



Minimize 



.L 

j eG 



c . X . 



: J 



Subject to 



L a 

j eG 
X . > 

J - 



jXj = b (mod D) 
0 and integer. 



where the constraint in (19) is a congruence and D is the 

determinant of the coefficients of the x^ , (ieG) from (17) 

or a reduced value. It is assumed that c., a. and b are 

J J 

integers. The c^ in (19) are the c^ in (18) multiplied by 
D. The congruence in (19) is developed by finding the 
equation in (18) , including the objective function, that 
has any constant, written in fractional form, having the 
property that its numerator and denominator are relatively 
prime. In this case the denominator is D. Gomory [14] 
shows that if we find a constant with this property then 
the congruence taken from the equation where the constant 
appears generates the congruences developed from the other 
equations. The cutting plane developed from the congruence 
represents the best cutting plane since any integer solution 
to the congruence produces integer solutions for the x^ 

(ieG) in (18) . 
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Although it may appear that the search for a constant 
with the property that numerator and denominator are rel- 
atively prime is a tedious one, there is a simple and rapid 
way to find the equation containing the constant. The re- 
vised simplex method is used to obtain the linear program- 
ming solution to (17) . Therefore the inverse matrix is 
available to develop the constants in (18) . In solving (17) 
the value of D is carried along as the product of the pivot 
elements. The desired equation is found by finding the 
greatest common divisor of the non-zero mmerators of each 
of the rows of the inverse matrix. The procedure is stopped 
when the greatest common divisor is unity. If none of the 
rows produce a greatest common divisor of unity, the row 
with the minimiam greatest common divisor is selected. The 
greatest common divisor of the greatest common divisors of 
each row also divide D thereby producing a smaller value of 
D by dividing. An enlarged inverse matrix is also used in 
considering the objective function. The procedure in [5] 
is used to find the greatest common divisor of the elements 
of each row of the inverse matrix. 

Before the above procedure, the Euclidean algorithm 
is used to examine the aQ and d. When a fractional constant 
having unity as the greatest common divisor of the numerator 
and denominator is found, the procedure stops. If the re- 
quired row is not found then the inverse matrix is used as 
described above. 
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A problem which is given in [3], to illustrate Gomory's 



algorithm. 


is solved 


below by 


the 


method just described 


( 20 ) 


min + 4xj^ 


+ 


5X2 






subject to 


3 k ^ 


+ 


^2 


^3 


2 




^1 


+ 


4X2 - 


X 4 = 


5 




3Xj^ 


+ 


2 X 2 ■ 


II 

in 


7 



Xj ^ 0 and integer. 
The continuous solution gives us 



^ 112 ^ 1 ^11 

(21) min + ^ + + jjXj 

2 4 _ 18 

^1 10^4 10^5 " 10 

_ _3 1 _ _8 

^2 10 4 10^5 “ 10 

3 _ 11 _ 42 

^3 10^4 10 5 “ 10 

where D = 10. 



Considering d = 



112 

10 ' 



ot. 



fli ^ 

^ 10 ' 10 ' 10 ^ 



we see that none 



have numerator and denominator relatively prime. The in- 
verse matrix is 



0 

0 

-1 

0 



-2 


4 


10 


10 


3 


-1 


10 


10 


-3 


11 


10 


10 


-7 


-11 


10 


10 



0 

0 

0 

1 



where the bottom row produces the coefficients in the ob- 
jective function. In the first row we consider the great- 
est common divisor of (-2,4) which is 2. The first row 
produces the first constraint equation in (21) . In the 
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second row we consider the greatest common divisor of (3,-1) 
which is unity. Thus the required congruence may be obtain- 
ed from the second constraint in (21). Similarly, the re- 
quired congruence may be obtained from the third constraint 
and the objective function. Using the second constraint 
we obtain the congruence 

7x^ + 8 (mod 10 ) . 

The equivalent knapsack problem becomes 
minimize 7x, + llx^ 

4 D 

when 7x^ + x^ s 8 (mod 10 ) 

X 4 , Xj ^ 0 and integer. 

In general, once the required equation in (18) is found, 
e , g • , 

X. + y a..x. = a. for a single ieG 

(or for the objective function) the congruence is found as 
in Gomory [13] as 



y a . .X - a . n 

jeG 3 lO 



(mod 1 ) 



where a. . is the fractional part of a. , 

13 ^ 13 

through by D, we obtain 

y_ a.x. = b (mod D) 



j £ G 



3 3 



Multiplying 



where 



a- = a..D, b - a ,.,D 
3 13 ' lO 



We are now interested in a solution to the equivalent 
knapsack problem which is in the form of (19) . We can 
assume that no value of a^ appears more than once (if not, 
we can select the one with smallest c^ value) . Writing 
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F(y) = min 



n n 

I c .X . I I a.x. E y (mod D) 
j=l 3 3 j=i 3 3 

We obtain the recursion as in [9] 

(22) F(y) = min (Cj+F(y-aj)) , 

with F(0) = 0. The arguments of F are taken modulo D. We 
can write (22) ;. as 

(23) F(y) = c + min (c.-c +F(y-a. ) ) 

j J J- J 

where c = min c.. Equation (23) has an immediate solution 

^ j ^ 

for y = and we obtain F(a^) = c^. We then write (23) as 

(24) F(y-a^) = + min (c . -c^+F (y-a^-a . ) ) . 

We substitute (24) for the F(y-a^) term on the right side 
of (23) and produce another solution to some F(aj). We stop 
when we have achieved a solution for F(b). We also keep 
track of the variable j which produces each solution and 
then backtrack to find the x^ . This entire procedure can 
be summarized in the following algorithm: 

1. List the values of the problem as follows: 



Go to 2 . 
2. Given the 
1 2 

^1 ^2 
^1 ^2 






n 



U ^2 



n 



ai a3 



n 



list 

3 



n 



n 









n 






^t 
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find = min for all unmarked columns. Set 
F(a^) = and I(a^) = r, where a^ and r are corres- 
ponding elements to in the column. If a^ = b go to 
4. Otherwise mark the column if it is one of the first 
n . Go to 3 . 

3. Add columns to the list, if possible, as follows: 

Calculate ^ ^r ^ ^t ^t ” ^r ^t 

t = l,...,n. Add a column headed by t if: 

(a) F(a^) has not been foundo 

(b) a^ is not on the list. 

(c) a^ is on the list and has a corresponding c^ 
value that is larger than c’^. 

Delete columns (beyond the first n) having elements a^ 

(d) after F(a^) is found. 

(e) after a new a^ is found as in 3(c). 

Go to 2 . 

4. The problem is solved with solution F(b), The values 
of the variables are found as follows: 



(a) 


Set X . : 
3 


= 0, 


j = 1 , . o . ,n and 


y = 


= b. Go 


to 4 (b) . 


(b) 


Look up 


Ky) 


= j „ Set X . = 


X . 

3 


+ 1 . Go 


to 4 (c) 


(c) 


Set y = 


Y - 


a^ (mod D) . If 


y = 


- 0 go to 


5. 



Otherwise go to 4 (b) . 



5. End. The final values are the required ones. 

This completes the algorithm. If solutions are desired 
for all values of y then the algorithm can be continued in- 
stead of stopping when b is reached. Continuing with our 
example and using the algorithm of Greenberg [16] , the 
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equivalent knapsack problem is 
Minimize 7x^ + llx^ 



Subject to 7x^ + 

X4, Xg 

we list 

4 5 

7 11 

7 1 

Thus 7 = min c^ , F(7) = 7, 

(Marking the first column) 

4 5 

7 11 

7 1 

* 

Thus F(l) = 11, 1(1) = 5. 

4 5 

7 11 

7 1 

* * 

F(4) = 14, 1(4) = 4. The 

4 5 

7 11 

7 1 

* * 



x^ = 8 (mod 10) 

> 0 and integer. 



1(7) = 4. The list becomes 

4 5 

14 18 

4 8 

The list becomes 
4 5 5 

14 18 22 

4 8 2 

ist becomes 

4 5 5 

18 22 25 

8 2 5 



F(8)=18, I(8)=4. We stop. 

Backtracking 1(8) = 4, x^ = 1 

1(1) = 5 , Xj = 1 , end. 

The solution is F(8) = 18, x^ = 1, x^ = 1. 
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Approximately 25 problems have been tried using this 
method [16] where there was a maximum of 2000 variables and 
150 equations <, The method was used to solve integer pro- 
grams arising as covering problems c Usually the method 
produces an immediate integer solution o If the knapsack 
solution does not produce feasible (positive) integers to 
the problem, success has always been obtained by adding a 
single cut. 

The above algorithm has been extended by Greenberg [17] 
for integer solutions to bounded variable linear programs. 

As previously, the continuous linear programming solution 
is first found. If the continuous solution is fractional 
then a linear congruence is added as a constraint. The 
problem is then put into a dynamic programming format and 
the optimal integer solution found. 

The algorithm presented is for solving 
(25) Minimize CX 

Subject to AX = B 

0 _< Xj £ t) j r Xj integer, j=l,...,n, 
where X = (x^,.,,,x^) , C is an n-vector, B is an m-vector, 

A is an mxn matrix and the b^ are integers. It is assumed 
the elements of C, B, and A are integers. In this formula- 
tion the bj may be infinite. This algorithm also includes 

the case where the x. are restricted to be either zero or 

D 

one , 

A bounded variable linear programming technique is 
used to obtain the linear programming solution to (25). 

This transforms (25) to 
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(26) Minimize d + J c.x. 

jcG 3 3 

Xg - Jg = “O' 

0 £ Xj £ bj , Xj integer, j=l , . . . ,n, 
where the vector X_ = {x. ieG}, G is the set of indices of 

Vj J. 

the basic variables, and G is the set of indices of the non- 

basic variables. Further, some of the non-basic variables 

may be at their upper bounds in the continuous solution of 

(25) . For those variables their corresponding c^ values 

are non-positive. Also, ^ 0 for non-basic variables that 

are at the zero value. For ease of computation, we make 

the transformation x'. = b. - x. for those non-basic var- 

D 3 3 

iables at their upper bound. Thus we may assume a form 
like (26) with all Cj 0 and all non-basic variables at 
zero values. The vectors aj(j=0 and jeG) are column vec- 
tors. The components of Uq are non-negative. If aQ is all 
integer then x^ = 0 (jeG) , is an optimal solution 

(if any of the x^ , jeG are really the x^ under the trans- 
formation, then Xj = bj). If any of the are fractional, 
problem (26) is converted to the problem: 

(27) Minimize l_ c.x. 

jeG ^ ^ 

when y a.x. < 

j£G 3 3 - 0 

^ a.x. = b (mod D) 
jeG ^ ^ 

0 _< Xj _< bj , Xj integer, jeG. 
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The inequality constraintb in (27) are obtained from (26) 
by dropping the , itcj, D ie the deteiinlnant of fhe oo- 
efficients of the , aeG from (25). The value of D may 
be found as the product of the pivot elemente during the 
simplex procedure for obtaining the continuous solution of 
( 25 ) . The linear congruence in (27) is a single congruence 
where the and b are integers* The congruence results 
from the requirement that all.x^* i^G, be integers. 

After finding the congruence in (27) a dynamic program- 
ming formulation of (27) is developed. Writing 

P(x,tt,8) • min c.x.l a,x. < a , 

IjeG ■' JeG ^ =* 

a.x. - X (mod D) , 0 <* e.x. 8 
3 J ""3 3*^ 

the dynamic programming recursion 

(28) P(x,a,8) ® rain (c ,tP(x-a . .a-a . ,8-e . ) ) 

JrG J J J J 

F(0,u,8) * 0 for a ^ 0, 8 ^ d, 
is obtained. The x arguitient of F is taken modulo D. The 
vector is composed of a unit element with the other el- 
ements zero. The unit element corresponds to the unit co- 
efficient of X. in X . b,, it Is assiuned that only £ea- 

j J - 1 

slble values of x, u, and 8 are used in (28). 

One Immediate solution to (28) can be obtained by 
finding » min c . . This produces F(a ,(i .e ) c . Then 

i ij fc ± £ 

replace x by x - a by t* - a^, and H by 8 - e^ In (28) 
and substitute the result for the F(x-a^,os-ap,8“8^) t^rm on 
the right side of (28) , then another immediate solution can 
be produced. Continue this way until F(b,«,8) is found 
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where 0 £ o^q ” cx £ and 3 £ b- where the vector 

bg = {b^|ieG} and the vector bg = {b^|ieG}. This entire 

procedure is contained in the following algorithm: 

1. Suppose the indices in G are (l,2,...,m), list 
the values of the problem as 



m 



Cl C3 



m 



Cl C2 U3 



a_ 



m 



^1 ^2 



m 



X. = 0 
D 

Go to- 2. 

Given the list, find c^ = min Cj for all unmarked 
colximns in all sections. If a^ = b and 



0 < a« - < b_ go to 4 . Otherwise mark the 

column and go to 3. 

Add a new section of colunuis to the list, if pos- 
sible, as follows: 

(a) calculate c'. = c + c., a'. = a + a., 

3 ^ 33^3 

a'. E + a . (mod D) for all values of jeG 
3 r j ' ■> 

(i.e., values j, c., a., a. are taken from 

3 3 3 

the list in step 1.) where < b^ for 
j 7 ^ r and where x^ + 1 < b^ for j = r for 
the section containing the newly marked 
column. 

(b) add the column headed by j in the new section 
with values c^ , and a ^ . 
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(c) Underneath the section added write the x. 

D 

values from the section containing the newly 
marked column. Increase by one for the 
section. When columns in new sections become 
marked they may be deleted after the calcula- 
tions are made and the new section is added 
to the list, A new column may already be on 

the list. It need not be added if the x. 

D 

values in corresponding sections would co- 
incide (after increasing the x^ values by one 
for the j heading values of the two columns) . 
Go to 2. 

4. The integer problem is solved with objective func- 
tion value d + c . The values of the basic var- 

r 

iables in (26) are X_ = a^. - a^. The values of 
the non-basic variables are found below the section 
where a^ = b appears; increase x^ by one. 

This completes the algorithm. The algorithm may be 
simplified by calculating al only when al = b by using the 
proper x^ values and the from step 1. An integer solu- 
tion is sure to be found because all integer solutions to 
the congruence in (27) are systematically produced in order 
of increasing objective function value. 
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To illustrate this procedure we use the problem given 



in [ 2 ] as 



Minimize 


5X3^ + 


7x2 


+ 


10x3 + 


3x4 


+ X, 


when 


^1 - 


3x2 


+ 


5X3 + 


^4 


- 4 x 




-2X3^ + 


6X2 


- 


3X3 


2x4 


+ 2x 




- 


X2 


+ 


2X3 - 


^4 


X 




0 < X . 
- 3 


1 


X . 

J 


integer. 


j = l i • 


. . , 5 « 


introduce 


surplus 


variables 


Xg > 0, 


1 V 


0 , and 



> 1 



We 

(i.e., with 00 as upper bounds) and find the continuous 
solution and equivalent problem: 

(29) Minimize 



Q ^ 93 

9 + 



7 

9^1 



^ 156 ^ 42 

^ —^4 + —^5 



^ 24 ^ 137 

+ + —^8 



when 



28 13 1 

~^4 + “ 9^5 + ^6 ^^7 



2 ^ 8 4 

- + X 3 - - ^x^ 

4 ^ 7^1 

- 9X3^ + X2 - + ^Xg 



- ix 

9 X 7 

2 

9 X 7 



3^8 “ 3 

ix = i 

3^8 3 



3^8 " 3 



0 £ Xj £ 1, Xj integer, j=l,...,5 
0 £ X j , j= 6 , 7 , 8 . 

We have D = 9. The second equation produces the congruence 
7 X 3 ^ + x^ + 5Xg + 8 x,y + 3Xg = 6 (mod 9) 
which is added as a constraint. Multiplying through by 9 
where applicable, we list 
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(30) 




i 


4 


S 


1 ^ 


8 




9 


93 


116 


42 


24 


137 




3 


”7 


-28 


13 


1 


-3 




i 


»2 


- 8 


-4 


-1 


-6 




3 


-4 


-7 


1 


-2 


3 




I 


7 


1 


S 


8 


3 



*1 • “ 

@@nv@ni§n3@ w@ at th@ l@£t of th@ list the 

funstlon valug, the ^-ight hand sides (multiplied 
I) the egualitiee in (29) , and the right hand side 
f©f the sengruenee^ We have 24 s min , l,e., « 24, 

with t s 7. We add the eeetion 



1 


4 


s 


7 


8 


117 


100 


66 


48 


161 




- 1.7 


14 


2 


-2 


= 3 


“9 




“2 


-7 


*1 


“1 


-1 


-4 


1 


1 


0 


4 


7 


3 




We fflatk the 1 eelumn in (JO). We have min ® 42 from . ; 

(19) I we add the eeetion 



1 


4 


8 


131 


118 


178 


i 


UST) 

II 


10 


-6 


= 13 


= 10 


-3 


= 1 


4 




6 


R 


^5 


- 1 , 





&2 



We need not add a column headed by 7 in (32) because it 
would duplicate the 5 column in (31) (the use of either 
column would require = 1 and = 1) . We do not add a 
5 column in (32) since would be at its upper bound in 
(32). We mark the 5 column in (30). We have min c^ = 48 
in (31) . We add the section 





(33) 


1 4 


5 


7 


8 






141 204 


90 


72 


185 






-5 -26 


15 


3 


-1 






-4 -10 


-6 


-3 


-8 






-8 -11 


-3 


-6 


-1 






5 8 


3 


6 


1 






Xy = 2 








We 


mark the 7 


column in 


(31) . 


We 


have min c^ = 66 from 


(31) . We add 


the section 








(34) 


1 


4 


8 








159 


222 


203 








-7 


-14 


11 








-7 


-13 


-11 








-5 


-8 


2 








2 


5 


7 








^1 


= 1, 


^5 = 


1 


We 


mark the 5 


column in 


(31) . 


The 


1 solution is now apparent 


in 


the 7 column in (33) . 


We 


have 


the optimal solution 


X7 


= 3 , Xj = 


(3-3)/9 = 0 


, X3 


= (6+3)/9 = 1, X2 = (3+6)/9 = 1 



the value of the objective function is 9 + 72/9 = 17. 
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7. Summary 

Since 1954, the field of integer programming has made 
rapid progress. Many new approaches have been tried on 
various type problems with varying amounts of success. The 
developments in computers have enabled many problems to be 
solved today that fifteen years ago could not be handled. 
Many computer codes have been developed around the algor- 
ithms presented here. Information on computational expe- 
rience with these codes is scarce and publications in this 
area are lacking. The little information that is available 
indicates there is much to be tried and certainly room for 
clever imaginative schemes for solving this type of prob- 
lem. Possibly the best approach or method for solution 
will be a scheme employing all of the categories described 
in this thesis. 
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